Causal Rate Distortion Function and Relations to Filtering Theory
نویسندگان
چکیده
A causal rate distortion function (RDF) is defined, existence of extremum solution is described via weak-convergence, and its relation to filtering theory is discussed. The relation to filtering is obtained via a causal constraint imposed on the reconstruction kernel to be realizable while the extremum solution is given for the stationary case.
منابع مشابه
Realizable Rate Distortion Function and Bayesian FIltering Theory
The relation between rate distortion function (RDF) and Bayesian filtering theory is discussed. The relation is established by imposing a causal or realizability constraint on the reconstruction conditional distribution of the RDF, leading to the definition of a causal RDF. Existence of the optimal reconstruction distribution of the causal RDF is shown using the topology of weak convergence of ...
متن کاملCausal Rate Distortion Function on Abstract Alphabets and Optimal Reconstruction Kernel
A Causal rate distortion function with a general fidelity criterion is formulated on abstract alphabets and the optimal reconstruction kernel is derived, which consists of a product of causal kernels. In the process, general abstract spaces are introduced to show existence of the minimizing kernel using weak∗-convergence. Certain properties of the causal rate distortion function are presented.
متن کاملCausal Rate Distortion Function on Abstract Alphabets: Optimal Reconstruction and Properties
A causal rate distortion function with a general fidelity criterion is formulated on abstract alphabets and a coding theorem is derived. Existence of the minimizing kernel is shown using the topology of weak convergence of probability measures. The optimal reconstruction kernel is derived, which is causal, and certain properties of the causal rate distortion function are presented.
متن کاملOptimal causal inference: estimating stored information and approximating causal architecture.
We introduce an approach to inferring the causal architecture of stochastic dynamical systems that extends rate-distortion theory to use causal shielding--a natural principle of learning. We study two distinct cases of causal inference: optimal causal filtering and optimal causal estimation. Filtering corresponds to the ideal case in which the probability distribution of measurement sequences i...
متن کاملRate-distortion function via minimum mean square error estimation
We derive a simple general parametric representation of the rate–distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the distortion ∆ = d(X, Y ) based on the source symbol X , with respect to a certain joint distribution of these two random variables. At first glance, these rel...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1104.0862 شماره
صفحات -
تاریخ انتشار 2011